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(57) An image processing apparatus comprising a 
compressing section to compress image data, 
an enlarging section to electrically enlarge the 
image data, and a control section to control the 
compressing section in accordance with a mag- 
nification of the enlarging section is provided. 
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BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to an image proc- 
essing apparatus and, more particularly, to an image 
processing apparatus having a processing function to 
electrically enlarge an image. 

Related Background Art 

An image pickup apparatus having image pickup 
means for converting an optical image into an electric- 
signal, for example, a video camera, an electronic still 
video camera, a television camera, or the like has a 
function to perform video effects such as snapping, 
hand vibration correction, electronic zoom, and the 
like by providing an image memory to temporarily 
store a photographed image. 

The image memory to temporarily store the pho- 
tographed image generally needs a memory capacity 
of at least one image plane (field or frame). For exam- 
ple, now assuming that each of the luminance signal 
and the color difference signal of one field is stored 
by eight bits, a memory capacity of 3 Mbits is needed 
in this instance, so that the size and costs of the im- 
age memory increase. 

Therefore, there has been proposed a construc- 
tion such that a compression encoding circuit is pro- 
vided on the input side of an image memory and an 
expansion decoding circuit is provided on the output 
side, of the image memory thereby decreasing the 
memory capacity of the image memory. 

In case of assembling an electronic zoom func- 
tion into a circuit construction to perform the com- 
pressing and expanding processes at the stages be- 
fore and after the storage into the image memory as 
mentioned above, the following troubles occur. 

First, the electronic zoom is a process such that 
a part of an image is cut out and, in order to enlarge 
the cut-out portion to a standard angle of view, the 
pixel values which lack are interpolated by the adja- 
cent pixel values, thereby electrically enlarging the 
image. 

Therefore, as a magnification of the electronic 
zoom is large, a deterioration of the image (picture 
quality) increases by the above interpolating process. 

Although a compressing process is executed in 
order to temporarily store the image signal into the im- 
age memory, the picture quality is fairly deteriorated 
by the compressing process. 

Consequently, in case of performing the elec- 
tronic zoom in the conventional image processing ap- 
paratus, the image is deteriorated by the compress- 
ing and expanding processes which are executed to 
temporarily store the image data into the image mem- 
ory and the electronic zooming process is performed 
to such a deteriorated image, so that the image is fur- 
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ther deteriorated. 

Such a problem as mentioned above also similar- 
ly occurs in an image processing apparatus such as 
a digital VTR for converting an analog image signal 
into a digital image signal and recording onto a record- 
ing medium. 

In the digital VTR, when a digital image signal is 
recorded onto the recording medium, the image sig- 
nal is compressed. Therefore, when the image which 
was subjected to the electronic zooming process 
mentioned above is recorded, the image which was 
deteriorated by the electronic zoom by the compress- 
ing process is further deteriorated. 



15 SUMMARY OF THE INVENTION 



Under such circumstances, it is an object of the 
invention to solve the above problems and to provide 
an image processing apparatus which can prevent an 
image deterioration when an image is electrically en- 
larged. 

To accomplish the above object, according to one 
preferred embodiment, there is provided an image 
processing apparatus comprising: compressing 
means for compressing image data; enlarging means 
for electrically enlarging the image data; and control 
means for controlling a compression ratio of the com- 
pressing means in accordance with an enlargement 
ratio of the enlarging means. 

The above and other objects, features, and ad- 
vantages of the invention will become apparent from 
the following detailed description taken in conjunction 
with the appended claims. 
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35 BRIEF DESCRIPTION OF THE DRAWINGS 



Fig. 1 is a block diagram of a camera integrated 
type VTR according to the first embodiment of 
the invention; 

Fig. 2 is an internal circuit diagram of a compres- 
sion circuit 18 in Fig. 1; 

Figs. 3A to 3C are diagrams for explaining the 
compression processing operation of the com- 
pression circuit 18; 

Fig. 4 is a diagram showing an internal circuit of 

an expansion circuit 24 in Fig. 1; 

Fig. 5 is an internal circuit diagram of a selector 

20; 

Fig. 6 is an internal circuit diagram of a selector 
26; 

Fig. 7 is a schematic explanatory diagram when 
an electronic zoom magnification is set to two 
times; 

Fig. 8 is a schematic explanatory diagram when 
an electronic zoom magnification is set to four 
times; 

Fig. 9 is a timing chart of the selector 20 in case 
of the electronic zoom of four times; 
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Fig. 1 0 is a timing chart of the selector 26 in case 
of the electronic zoom of four times; 
Fig. 11 is a block diagram of a camera integrated 
type VTR according to the second embodiment of 
the invention; 

Fig. 1 2 is an internal circuit diagram of a compres- 
sion circuit 18' in Fig. 11; 

Fig. 13 is an internal circuit diagram of an expan- 
sion circuit 24' in Fig. 11; 

Fig. 14 is a schematic explanatory diagram when 
an electronic zoom magnification is set to 1.5 
times; and 

Fig. 15 is a block diagram of a camera integrated 
type digital VTR according to the third embodi- 
ment of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

A video camera of t he first embodiment according 
to the invention will be described as an example here- 
inbelow. 

Fig. 1 is a constructional block diagram of a cam- 
era integrated type VTR of the first embodiment ac- 
cording to the invention. 

In Fig. 1, reference numeral 10 denotes a photo- 
graphing lens; 12 an image pickup element to convert 
an optical image into an electricsignal; 14 an A/D con- 
verter to convert an analog image signal from the im- 
age pickup element 12 into a digital image signal; and 
16 a digital signal processing circuit (DSP). The DSP 
16 executes well-known camera signal processes 
such as gamma correction, color balance adjustment, 
and the like and generates image signals in forms of 
a luminance signal of eight bits and 8-bit color differ- 
ence signals. Explanation will now be made hereinbe- 
low with respect to the luminance signal to make the 
description easy. 

Reference numeral 18 denotes a compression 
circuit to compress output data of the DSP 16 into 1/4 
and 20 indicates a selector to select the output of the 
DSP 16 or an output of the compression circuit 18. 

Reference numeral 22 denotes an image mem- 
ory which can store the image data of one image 
plane compressed by the compression circuit 18. In 
case of compressing the image data of one standard 
image plane into 1/4, the image data of one image 
plane can be stored into the image memory 22 of the 
embodiment. 

Reference numeral 24 denotes an expansion cir- 
cuit having an expansion ratio corresponding to a 
compression ratio of the compression circuit 18 and 
26 indicates a selector to selectively supply an output 
of the image memory 22 to the expansion circuit 24 
or an electronic zoom circuit 28. 

Reference numeral 28 denotes the electronic 
zoom circuit to electrically enlarge a signal from the 
expansion circuit 24 or selector 26; 29 a change-over 



switch to select the output from the DSP 16 or the out- 
put from the electronic zoom circuit 28; 30 a D/A con- 
verter to convert the digital signal into the analog sig- 
nal; 31 an electronic view finder (EVF) to electrically 

5 display the digital signal generated from the D/A con- 
verter 30; 34 an operation unit to input a command (for 
instance, an electronic zoom magnification or the 
like) of the electronic zoom function; and 36 a system 
control circuit to control the selectors 20 and 26, elec- 

10 tronic zoom circuit 28 (for example, a zoom magnifi- 
cation), and change-over switch 29 in accordance 
with a command from the operation unit 34. 

Reference numeral 37 denotes a recording proc- 
essing circuit for executing a predetermined process 

15 (for instance, modulation or the like) to record the im- 
age data onto a magnetic tape 39; 38 a magnetic 
head; 39 a magnetic tape. 

Fig. 5 shows an internal circuit of the selector 20. 
Fig. 6 shows an internal circuit of the selector 26. Fig. 

20 6 shows a circuit portion for directly supplying the 4- 
bit data from the image memory 22 to the electronic 
zoom circuit 28 without expanding the 4-bit data. 
There is a circuit (not shown) to supply the 4-bit data 
from the image memory 22 to the expansion circuit 

25 24. 

The selector 20 has a converting function to div- 
ide the 8-bit data which is generated from the DSP 16 
into two 4-bit data of upper four bits and lower four 
bits. The selector 20 also has a gating function for al- 
30 lowing the image data in arbitrary horizontal and vert- 
ical regions in the image plane to pass by a horizontal 
window signal (H_WINDOW) and a vertical window 
signal (V_WINDOW). 

On the other hand, the selector 26 contrarily has 
35 a converting function for combining the above two 4- 
bit data to the 8-bit data (allocates to the upper four 
bits and the lower four bits) as will be explained in de- 
tail hereinbelow. 

Fig. 2 shows an internal block diagram of the 
40 compression circuit 18. 

In Fig. 2, the 8-bit data supplied from the DSP 16 
is sent to an input terminal 40. 

A prefilter 42 eliminates the slant component of 
the luminance data transmitted from the input termi- 
45 nal 40 as a pre-process of the subsampling. A sub- 
sampling circuit 44 thins out an output of the prefilter 
42 into 1/2 in the horizontal direction. Further, an out- 
put of the subsampling circuit 44 is compressed into 
1/2 by a DPCM circuit 46. Namely, the compression 
so circuit 18 compresses the input image data into 1/4 
and generates the compressed data. 

A state of compression will now be practically ex- 
plained with respect to the case of the luminance sig- 
nal. As shown in Fig. 3A, it is assumed that the lumi- 
55 nance data of the original image is constructed by 640 
pixels in the horizontal direction, 240 lines, and eight 
bits and is a field image of about 1.23 Mbits. 

By subsampling the luminance data by the sub- 



3 



BNSDOCID: <EP 058621 8A1_I_> 



5 



EP 0 586 218 A1 



6 



sampling circuit 44, as shown in Fig. 3B, the number 
of pixels in the horizontal direction is reduced to 1/2 
and is set to 320 and the data is set to about 0.61 
Mbits per field. 

By further compressing the luminance data into 
four bits from eight bits by the DPCM circuit 46, as 
shown in Fig. 3C, the data is compressed into 1/2 in 
the depth direction and is set to about 0.3 Mbits. 

Fig. 4 shows an internal block diagram of the ex- 
pansion circuit 24. 

In Fig. 4, the 4-bit data from a contact point (a) of 
the selector 26 is supplied to an input terminal 50. 

A DPCM decoding circuit 52 DPCM decodes the 
4-bit data from the input terminal 50 and generates 
the 8-bit data. 

An interpolation circuit 54 interpolates the pixels 
which were thinned out by the subsampling circuit 44 
by, for example, inserting a zero value or an average 
value of the values of the pixels which are located on 
both sides or near positions. 

An output of the interpolation circuit 54 is smooth- 
ed by a post-filter 56 and is supplied from an output 
terminal 58 to the electronic zoom circuit 28. 

Namely, in the expansion circuit 24, the DPCM 
decoding circuit 52 expands the data from four bits to 
eight bits in the depth direction and the interpolation 
circuit 54 doubles the number of pixels in the horizon- 
tal direction. Consequently, the image data which is 
generated from the output terminal 58 is set to 640 x 
240 x 8 bits. 

Although not shown, two systems of the circuits 
as shown in Figs. 2 and 4 are provided for the lumi- 
nance signal and for the color difference signals in 
the compression circuit 18 and expansion circuit 24. 

In the embodiment, since the compression factor 
of the compression circuit 18 is set to 1/4, when a 
zoom magnification of the electronic zoom circuit 28 
is equal to or larger than four times, the effect which 
is peculiar to the embodiment can be obtained. 

The image processing operation when executing 
the electronic zoom function in the first embodiment 
will now be described hereinbelow. 

In the embodiment, in the ordinary photograph- 
ing mode, the change-over switch 29 is connected to 
the (c) side and no image signal is stored into the im- 
age memory 22. When a command to execute the 
electronic zoom function is inputted from the opera- 
tion unit 34, the switch 29 is connected to the (d) side 
and the image signal is stored into the memory 22. 

The operation in the case where the command to 
execute the electronic zoom function is inputted from 
the operation unit 34 and the electronic zoom magni- 
fication is less than four times will now be described. 

The system control circuit 36 connects each of 
the selectors 20 and 26 to the (a) contact point. 

The image pickup element 12 converts the opti- 
cal image obtained by the photographing lens 10 into 
the electric signal. The A/D converter 14 converts the 



output of the image pickup element 12 into the digital 
signal. 

The output data of the AfD converter 14 is proc- 
essed by the DSP 16 and is sent to the compression 
5 circuit 18 after that. 

The compression circuit 18 compresses the 8-bit 
image data into 1/4 as mentioned above. 

The output of the compression circuit 1 8 is the 4- 
bit data and is temporarily stored into the image mem- 
10 ory 22 as it is through the selector 20. 

The compressed image data stored in the mem- 
ory 22 is read out and transmitted to the expansion 
circuit 24 through the selector 26. 

The expansion circuit 24 expands the supplied 
15 compressed image data as mentioned above and 
sends to the electronic zoom circuit 28. 

The electronic zoom circuit 28 electrically magni- 
fies the input image by a magnification designated by 
the system control circuit 36. For example, in case of 
20 the zoom of two times (refer to Fig. 7), the image data 
of (453 pixels in the horizontal direction) x (170 lines 
in the vertical direction) of the central portion of the 
input image is extracted and is subjected to the inter- 
polating process and is generated as an image of (640 
25 pixels) x (240 lines). 

The digital image data generated from the elec- 
tronic zoom circuit 28 is converted into the analog im- 
age data by the D/A converter 30 and is subjected to 
a predetermined process (for example, modulating 
30 process or the like) by the recording processing cir- 
cuit 37 and is recorded onto the magnetic tape 39 by 
the magnetic head 38. The photographed image (im- 
age which was electronically zoomed) can be also 
displayed by the EVF 31. 
35 The operation in the case where the command to 

execute the electronic zoom function is inputted from 
the operation unit 34 and the electronic zoom magni- 
fication is set to four times will now be described here- 
inbelow. 

40 When the electronic zoom magnification is equal 

to four times (refer to Fig. 8), only the image data of 
(320 pixels in the horizontal direction) x (120 lines) of 
the central portion of the standard photographed im- 
age data (640 pixels x 240 lines) is extracted and stor- 

45 ed into the image memory 22. That is, in case of stor- 
ing only the extracted image data (320 pixels x 120 
lines), an amount of extracted image data is equal to 
1/4 of the amount of standard image data (640 pixels 
x 240 lines). As a data amount, consequently, this 

so means that the whole standard image data is com- 
pressed into 1/4 by the compression circuit 18. In the 
embodiment, therefore, when the electronic zoom 
magnification is equal to or larger than four times, 
only the data of necessary central portion of the pho- 

55 tographed image which is electronically zoomed is not 
compressed but stored into the image memory 22. 

First, the system control circuit 36 connects each 
of the selectors 20 and 26 to the (b) side. 
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The image data from the image pickup element 
12 is processed by the A/D converter 14 and DSP 16 
and supplied to the (b) side of the selector 20. 

Fig. 9 shows an operation timing chart of the se- 
lector 20. In the 8-bit output (non-compressed data) 
of the DSP 16, the image data included in the 161st 
to 480th pixels of the horizontal line and the image 
data included in the 61st to 180th lines are selected 
by the H_WINDOW signal and VJ/VINDOW signal. 

The selected 8-bit data is divided into the two 4- 
bit data of lower four bits and upper four bits by an 
SETJHI signal and supplied to latch circuits of four 
stages and is sequentially supplied to the image 
memory 22 as 4-bit data in accordance with the order 
of lower four bits and upper four bits. 

As mentioned above, the image data of the cen- 
tral portion which is necessary when the electronic 
zoom magnification is equal to four times is stored 
into the image memory 22 in a non-compressed state. 

The non-compressed image data stored in the 
memory 22 is read out and sent to the selector 26. 

Fig. 10 shows an operation timing of the selector 

26. 

The 4-bit data is fetched to the upper four bits and 
lower four bits of latch circuits of eight stages by an 
SEL signal and is converted into the 8-bit data. When 
eight bits are collected, the 8-bit data is supplied to 
the electronic zoom circuit 28. 

The image data of the central portion (320 pixels 
x 120 lines) of the ordinary image data is supplied to 
the electronic zoom circuit 28. 

The image data sent to the electronic zoom circuit 
28 is interpolated, so that the ordinary image data of 
(640 pixels) x (240 lines) is generated. The digital im- 
age signal generated from the electronic zoom circuit 
28 is converted into the analog image signal by the 
D/A converter 30. The analog image signal is subject- 
ed to a predetermined process (for example, modulat- 
ing process or the like) by the recording processing 
circuit 37 and is recorded onto the magnetic tape 39 
by the magnetic head 38. The photographed image 
can be displayed by the EVF 31. 

As will be easily understood from the above de- 
scription, according to the first embodiment, in case 
of electronically zooming the photographed image 
data at a predetermined magnification or more, the 
compressing process is not executed, so that the de- 
terioration in picture quality can be reduced. 

A camera integrated type VTR of the second em- 
bodiment will now be described. 

Fig. 11 is a constructional block diagram of a vid- 
eo camera of the second embodiment according to 
the invention. In Fig. 11, the portions corresponding 
to those in Fig. 1 are designated by the same refer- 
ence numerals and their descriptions are omitted 
here. 

Reference numeral 17 denotes an image extract- 
ing circuit to extract only the necessary image data in 



the image data supplied from the DSP 16 in accor- 
dance with the electronic zoom magnification which 
is inputted from the operation unit 34. 

An internal circuit construction of a compression 

5 circuit 18' in Fig. 11 will now be described with refer- 
ence to Fig. 12. In Fig. 12, the portions corresponding 
to those in Fig. 2 are designated by the same refer- 
ence numerals and their descriptions are omitted. In 
the second embodiment, by providing a change-over 

10 switch 41 , the compression factor can be varied to 1 12 
or 1/4. The switch 41 is controlled by a system control 
circuit 36'. 

In the case where the compressing process is not 
executed, the switch 41 is connected to the (c) side, 

15 so that the non-compressed image data is transmit- 
ted into the image memory 22. 

In case of setting the compression ratio into 1/2, 
the switch 41 is connected to the (b) side. An amount 
of image data is compressed into 1/2 by the prefilter 

20 42 and subsampling circuit 44. The compressed im- 
age data is supplied to the memory 22. 

In case of setting the compression ratio into 1/4, 
the switch 41 is connected to the (a) side. An amount 
of image data is compressed into 1/4 by the prefilter 

25 42, subsampling circuit 44, and DPCM circuit 46. The 
compressed image data is supplied to the memory 
22. 

An internal circuit construction of an expansion 
circuit 24' in Fig. 11 will now be described with refer- 

30 ence to Fig. 1 3. In Fig. 1 3, the portions corresponding 
to those in Fig. 3 are designated by the same refer- 
ence numerals and their descriptions are omitted. In 
the second embodiment, by providing change-over 
switches 51 and 53, the expansion ratio can be 

35 changed in correspondence to the compression ratio 
of the compression circuit 1 8\ In the embodiment, the 
image data can be expanded by two or four times. 

When the image data supplied to the input termi- 
nal 50 is not compressed, the switch 53 is connected 

40 to the (b) side. The image data supplied to the input 
terminal 50 is directly generated from the output ter- 
minal 58 and transmitted to an electronic zoom circuit 
28'. When the image data sent to the input terminal 
50 has been compressed into 1/2, the switch 51 is 

45 connected to the (b) side and the switch 53 is con- 
nected to the (a) side. The supplied image data is ex- 
panded two times by the interpolation circuit 54 and 
post-filter 56 and transmitted to the electronic zoom 
circuit 28'. 

50 In the case where the image data sent to the in- 

put terminal 50 has been compressed into 1/4, each 
of the switches 51 and 53 is connected to the (a) side. 
The supplied image data is expanded four times by 
the DPCM decoding circuit 52, interpolation circuit 54, 

55 and post-filter 56 and transmitted to the electronic 
zoom circuit 28'. 

The image processing operation when executing 
the electronic zoom function in the second embodi- 
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ment will now be described hereinbelow. 

In the embodiment, in the ordinary photograph- 
ing mode (the electronic zoom function is not execut- 
ed), the change-over switch 29 is connected to the (c) 
side and no image signal is stored into the memory 
22. When a command to execute the electronic zoom 
function is inputted from the operation unit 34, the 
switch 29 is connected to the (d) side. The image sig- 
nal is stored into the memory 22 and is electronically 
zoomed. 

The operation in the case where the command to 
execute the electronic zoom function is inputted from 
the operation unit 34 and the electronic zoom magni- 
fication is set to a value less than two times will be 
first described. The case where the electronic zoom 
magnification is equal to 1 .5 times will now be descri- 
bed. 

The image pickup element 12 converts the opti- 
cal image obtained by the photographing lens 10 into 
the electric signal. The A/D converter 14 converts the 
output of the image pickup device 12 into the digital 
signal. 

The output of the A/D converter 14 is processed 
bythe DSP 16and is subsequently supplied to the im- 
age cutting-out circuit 17. 

As shown in Fig. 14, the image cutting-out circuit 
17 extracts the image data of (523 pixels in the hori- 
zontal direction) x (196 lines in the vertical direction) 
which is necessary for the electronic zoom process 
from the central portion of the image data (640 pixels 
in the horizontal direction) x (240 lines in the vertical 
direction) photographed. The extracted image data is 
supplied to the compression circuit 18'. 

The compression circuit 1 8' compresses the sup- 
plied image data into 1/4 as mentioned above. 

The compressed image data is temporarily stored 
into the memory 22. 

The compressed image data stored in the image 
memory 22 is read out and sent to the expansion cir- 
cuit 24'. 

The expansion circuit 24' expands the supplied 
compressed image data in accordance with the com- 
pression ratio as mentioned above and transmits to 
the electronic zoom circuit 28'. 

The electronic zoom circuit 28' electrically enlarg- 
es the input image into the image of the size of the 
standard image (refer to Fig. 14). 

The enlarged digital image data is converted into 
the analog signal by the D/A converter 30 and is sub- 
jected to a predetermined process (for example, mod- 
ulating process or the like) by the recording process- 
ing circuit 37. The processed signal is recorded onto 
the magnetic tape 39 by the recording head 38. The 
image which was electrically enlarged can be also 
confirmed by the EVF 31. 

The operation in the case where the command to 
execute the electronic zoom function is inputted from 
the operation unit 34 and the electronic zoom magni- 



fication is equal to or larger than two times and is less 
t han four times will now be described. The case where 
the zoom magnification is equal to two times will now 
be described as an example. 
5 The image pickup element 12 converts the opti- 

cal image obtained by the photographing lens 10 into 
the electric signal. The A/D converter 14 converts the 
output of the image pickup element 12 into the digital 
signal. 

10 The output of the A/D converter 14 is processed 

by the DSP 16 and is subsequently sent to the image 
cutting-out circuit 17. 

As shown in Fig. 7, the image cutting-out circuit 
17 extracts the image data of (453 pixels in the hori- 

15 zontal direction) x (170 lines in the vertical direction) 
which is necessary for the electronic zoom process 
from the central portion of the standard image data of 
(640 pixels in the horizontal direction) x (240 lines in 
the vertical direction) photographed. The extracted 

20 image data is transmitted to the compression circuit 
18'. 

The compression circuit 18* compresses the sup- 
plied image data into 1/2 as mentioned above. 

The compressed image data is temporarily stored 
25 into the image memory 22. 

The compressed image data stored in the image 
memory 22 is read out and transmitted to the expan- 
sion circuit 24'. 

The expansion circuit 24' expands the supplied 
30 compressed image data two times in correspondence 
to the compression ratio as mentioned above. The ex- 
panded image data is sent to the electronic zoom cir- 
cuit 28'. 

The electronic zoom circuit 28' electrically enlarg- 

35 es the input image to the image of the size of the stan- 
dard image (refer to Fig. 7). 

The enlarged digital image data is converted into 
the analog signal by the D/A converter 30. The ana- 
log signal is subjected to a predetermined process 

40 (for example, modulating process or the like) by the 
recording processing circuit 37. The processed signal 
is recorded onto the magnetic tape 39 by the magnet- 
ic head 38. The image which was electrically enlarged 
can be also confirmed by the EVF 31 . 

45 The operation in the case where the command to 

execute the electronic zoom function is inputted from 
the operation unit 34 and the electronic zoom magni- 
fication is set to four times or more will now be descri- 
bed. The case where the zoom magnification is equal 

so to four times will now be explained as an example. 

The image pickup element 12 converts the opti- 
cal image obtained by the photographing lens 10 into 
the electric signal. The A/D converter 14 converts the 
output of the image pickup device 12 into the digital 

55 signal. 

The output of the A/D converter 14 is processed 
bythe DSP 16 and is subsequently supplied to the im- 
age cutting-out circuit 17. 
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The image cutting-out circuit 17 extracts the im- 
age data of (320 pixels in the horizontal direction) x 
(120 lines in the vertical direction) which is necessary 
for the electronic zoom process from the central por- 
tion of the standard image data (640 pixels in the hor- 
izontal direction) x (240 lines in the vertical direction) 
photographed as shown in Fig. 8. The extracted im- 
age data is sent to the compression circuit 1 8*. 

The compression circuit 18' transmits the input 
image data into the image memory 22 without com- 
pressing it. The memory 22 temporarily stores the 
non-compressed image data. 

The image data stored in the memory 22 is read 
out and sent to the expansion circuit 24'. 

The expansion circuit 24' supplies the input im- 
age data to the electronic zoom circuit 28' without ex- 
panding it. 

The electronic zoom circuit 28' electrically enlarg- 
es the input image to the image of the size of the stan- 
dard image (refer to Fig. 8). 

The enlarged digital image data is converted into 
the analog signal by the D/A converter 30 and is sub- 
jected a predetermined process (for example, modu- 
lating process or the like) by the recording processing 
circuit 37. The processed signal is recorded onto the 
magnetic tape 39 by the magnetic head 38. The im- 
age which was electrically enlarged can be also con- 
firmed by the EVF31. 

As will be easily understood from the above ex- 
planation, according to the second embodiment, the 
compression ratio of the compression circuit 18* and 
the expansion ratio of the expansion circuit 24' can be 
varied and the compression ratio and expansion ratio 
are controlled in accordance with the electronic zoom 
magnification. Therefore, the deterioration in the pic- 
ture quality can be further reduced as compared with 
the first embodiment. 

A camera integrated type digital VTR according to 
the third embodiment will now be described. 

Fig. 1 5 is a block diagram of the camera integrat- 
ed type digital VTR of the third embodiment. 

In Fig. 15, reference numeral 100 denotes a pho- 
tographing lens; 102 an image pickup element; 104 a 
camera processing circuit to execute a predeter- 
mined camera process to an image signal derived 
from the image pickup element 102; 106 an A/D con- 
verter; 108 a change-over switch; 110 an electronic 
zoom circuit; 112 a D/A converter; 114 an electronic 
view finder (EVF); 116 a block forming circuit; 118 a 
DCT (Discrete Cosine Transform) circuit; 120 a quan- 
tization circuit; 122 a variable length encoding circuit 
(VLC); 124 a buffer memory; 126 a multiplexing cir- 
cuit; 128 a recording processing circuit; 130 a mag- 
netic head; 132 a magnetic tape; 134 a code amount 
control circuit; 136 an operation unit to instruct the 
execution of the electronic zoom function; and 138 a 
system control circuit to control the change-over 
switch 108, electronic zoom circuit 110, and code 



amount control circuit 134 in accordance with the op- 
eration of the operation unit 136. 

The electronic zoom circuit 110 comprises the 
compression circuit 18, selectors 20 and 26, image 

5 memory 22, expansion circuit 24, and electronic 
zoom circuit 28 which have already been described in 
the first embodiment. Or, the electronic zoom circuit 
110 comprises the image cutting-out circuit 17, com- 
pression circuit 18', image memory 22, expansion cir- 

10 cuit24', and electronic zoom circuit 28' which have al- 
ready been described in the second embodiment. 
The enlarging process is also similar to that described 
in the first or second embodiment. 

The recording processing operation in the ordi- 

15 nary photographing mode (the electronic zoom is not 
used) will be first described. 

The image pickup element 12 converts the opti- 
cal image derived by the photographing lens 10 into 
the electric signal and is subjected to a predeter- 

20 mined signal process by the camera processing cir- 
cuit 104. 

Image data generated from the camera process- 
ing circuit 104 is converted into the digital signal by 
the A/D converter 106. 
25 The digital signal is supplied to the block forming 

circuit 116 and the D/A converter 112 through the 
switch 108 (which is connected to the (a) side). 

The D/A converter 112 converts the digital signal 
into the analog signal. The photographed image can 
30 be displayed by the EVF 114. 

On the other hand, the block forming circuit 116 
divides the digital signal into a plurality of blocks each 
comprising (8 x 8) pixels. 

The divided block data is subjected to an ortho- 
35 gonal transformation by the DCT circuit 118 and is 
converted into frequency components. 

The frequency coefficient data generated from 
the DCT circuit 118 is sent to the quantization circuit 
120. 

40 In the quantization circuit 1 20, a set of data coef- 

ficients of every frequency component is divided by 
a numerical value which is controlled as will be ex- 
plained hereinlater, figures below decimal point are 
omitted, the number of bits is reduced, and a whole 

45 quantization data amount is compressed. 

The quantization data is sent to the VLC 122. 
In order to convert the quantization data into the 
one-dimensional data train, the data is scanned from 
the low frequency components in the horizontal and 

so vertical directions to the high frequency components 
in a zigzag manner. The data is rearranged and vari- 
able length encoding is executed to the rearranged 
data. 

The variable length encoded data is supplied to 
55 the code amount control circuit 134 and buffer mem- 
ory 124. 

The code amount control circuit 1 34 calculates an 
amount of encoded data and controls the quantization 
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coefficients of the quantization circuit 120 in a man- 
ner such that an amount of encoded data is set to a 
predetermined data amount in accordance with the 
result of the calculation. 

The encoded data is supplied from the buffer 
memory 124 to the multiplexing circuit 126 at a pre- 
determined data rate. 

An accumulation amount of data stored in the 
buffer memory 124 is supplied to the control circuit 
134. The quantization coefficients of the quantization 
circuit 120 are controlled so as not to cause an under- 
flow or overflow in the buffer memory 124. 

On the other hand, quantization step information 
is generated from the code amount control circuit 134 
to the multiplexing circuit 126. The multiplexing circuit 
126 multiplexes the encoded data and the quantiza- 
tion step information and executes a formating proc- 
ess for recording. An output signal of the multiplexing 
circuit 126 is subjected to a predetermined recording 
process (for example, modulating process) by the re- 
cording processing circuit 128. The processed signal 
is recorded onto the magnetic tape 132 by the mag- 
netic head 130. 

The recording processing operation using the 
electronic zoom function will now be described here- 
in-below. 

Only the processing portions different from the 
forgoing recording processing operation when the 
electronic zoom function is not used will now be ex- 
plained. 

When the execution of the electronic zoom func- 
tion is instructed by the operation unit 136, the switch 
108 is connected to the (b) side by the electronic 
zoom control circuit 138. 

The control circuit 138 controls the electronic 
zoom circuit 110 in accordance with the zoom mag- 
nification instructed from the operation unit 136. 

For example, when a command to set the elec- 
tronic zoom magnification to two times is generated 
from the operation unit 136, the electronic zoom cir- 
cuit 110 extracts the image data (453 pixels in the hor- 
izontal direction) x (170 lines in the vertical direction) 
of the central portion from the standard image data 
(640 pixels in the horizontal direction) x (240 lines in 
the vertical direction) as shown in Fig. 7. The image 
data is enlarged to the image of the size of the stan- 
dard image data by the interpolating process. 

The electronic zoom magnification information is 
generated from the electronic zoom control circuit 138 
to the code amount control circuit 134. 

In accordance with the electronic zoom magnifi- 
cation information supplied, the code amount control 
circuit 134 executes a shift control in such a direction 
as to reduce the quantization coefficients of the 
quantization circuit 120 as compared with those in the 
ordinary photographing mode. 

Namely, in the embodiment, by controlling the 
quantization step in accordance with the electronic 



zoom magnification, the compression ratio is reduced 
to a value smaller than that in the ordinary mode. The 
deterioration of the image which was electronically 
zoomed can be prevented. The digital image data can 

5 be recorded. 

The present invention can be embodied by the 
other various forms without departing from the spirit 
and main features of the invention. 

In other words, the foregoing description of the 

10 embodiments has been given for illustrative purpose 
only and not to be construed as imposing any limita- 
tion in every respect. 

The scope of the invention is, therefore, to be de- 
termined solely by the following claims and not limited 

15 by the text of the specifications and alterations made 
within a scoe equivalent to the scope of the claims 
fallen within the true spirit and scope of the invention. 



20 Claims 

1. An image processing apparatus comprising: 

a) compressing means for compressing im- 
age data; 

25 b) enlarging means for electrically enlarging 

the image data; and 

c) control means for controlling the compress- 
ing means in accordance with a magnification 
of said enlarging means. 

30 

2. An apparatus according to claim 1 , further having 
image pickup means for photographing an object 
image, thereby obtaining said image data. 

35 3. An apparatus according to claim 2, further having 
recording means for recording the image data 
compressed by said compressing means onto a 
recording medium. 

40 4. An apparatus according to claim 1 , further having 
display means for displaying the image enlarged 
by said enlarging means. 

5. An apparatus according to claim 1, wherein said 
45 enlarging means has memory means for storing 

the image data, and said memory means extracts 
the image data corresponding to a portion to be 
enlarged and stores the extracted partial image. 

so 6. An apparatus according to claim 1 , wherein said 
control means controls a compression ratio of 
said compressing means. 

7. An image processing apparatus comprising: 
55 a) converting means for converting image 

data into frequency component data; 

b) quantizing means for quantizing the con- 
version data converted by said converting 
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means; 

c) encoding means for encoding the data 
quantized by said quantizing means; 

d) instructing means for instructing so as to 
electrically enlarging said image data; 

e) enlarging means for electrically enlarging 
said image data in accordance with an output 
of said instructing means; and 

f) control means for controlling a quantization 
step of said quantizing means in accordance 
with an output of said instructing means. 

8. An apparatus according to claim 7, wherein said 
converting means is a DCT converting means. 

9. An apparatus according to claim 7, further having 
multiplexing means for multiplexing the data en- 
coded by said encoding means and quantization 
information regarding the quantization step 
which is controlled by said control means. 

10. An apparatus according to claim 7, further having 
recording means for recording the data encoded 
by said encoding means onto a recording me- 
dium. 

11. An apparatus according to claim 9, further having 
recording means for recording the data multi- 
plexed by said multiplexing means onto the re- 
cording medium. 

12. An apparatus according to claim 7, further having 
image pickup means for photographing an object 
image, thereby obtaining the image data. 

13. An image processing apparatus comprising: 

a) extracting means for partially extracting im- 
age data inputted; 

b) memory means for storing the partial im- 
age data extracted by said extracting means; 

c) enlarging means for electrically enlarging 
the image data stored in said memory means; 
and 

d) control means for controlling a size of par- 
tial image data which is extracted by said ex- 
tracting means in accordance with an enlarge- 
ment magnification of said enlarging means. 

14. An apparatus according to claim 13, further hav- 
ing image pickup means for photographing an ob- 
ject image, thereby obtaining the image data. 

15. An apparatus according to claim 13, further hav- 
ing compressing means for compressing the im- 
age data enlarged by the enlarging means and 
recording means for recording the image data 
compressed by said compressing means onto a 
recording medium. 



16. An apparatus according to claim 15, further hav- 
ing control means for controlling a compression 
ratio of said compressing means in accordance 
with the magnification of said enlarging means. 

5 

17. An image processing apparatus comprising: 

a) compressing means for compressing im- 
age data; 

b) instructing means for instructing so as to 
10 electrically enlarge the image data; 

c) enlarging means for electrically enlarging 
the image data in accordance with an output 
of said instructing means; and 

d) control means for controlling a compression 
15 ratio of said compressing means in accor- 
dance with an output of said instructing 
means. 

18. An apparatus according to claim 17, further hav- 
20 ing image pickup means for obtaining the image 

data. 

19. An apparatus according to claim 17, further hav- 
ing recording means for recording the image data 

25 which is generated from said compressing means 

onto a recording medium. 

20. An apparatus according to claim 17, further hav- 
ing display means for displaying the image data 

30 enlarged by said enlarging means. 

21. An image processing apparatus including: com- 
pression means for compressing image data; ex- 
pansion means for expanding image data; and 

35 control means for ensuring that the expansion ra- 

tio and compression ratios correspond. 
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